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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

• Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

• Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)13 Responsive to communication(s) filed on 21 August 2003 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) S Claim(s) 1^27 is/are pending in the application. 

4a) Of the above daim(s) is/are withdrawn from consideration. 

5) Q Claim(s) is/are allowed. 

6) 13 Claim(s) 1-27 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) 13 The drawing(s) filed on 04 April 2001 is/are: a)D accepted or b)S objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)D All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
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2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) d Notice of Informal Patent Application (PTO-1 52) 
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U.S. Patent and Trademark Office 

PTOL-326 (Rev. 04-01) 



Office Action Summary 



Part of Paper No. 14 





Application/Control Number: 09/746,045 
Art Unit: 2673 



Page 2 



Drawings 



1 . The drawings are objected to under 37 CFR 1 83(a). The drawings must show every 
feature of the invention specified in the claims. Therefore, the "coded control signal" must be 
shown or the feature(s) canceled from the claim(s). No new matter should be entered. 

A proposed drawing correction or corrected drawings are required in reply to the Office 
action to avoid abandonment of the application. The objection to the drawings will not be held 
in abeyance. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-9 are rejected under 35 U.S.C. 103(a) as being unpatentable over Lin (US Patent 
No. 6,346,933 Bl).. 

As to claim 1, Lin teaches a system with: at least one light source in a movable hand-held 
device, the movable hand-held device being capable of sending control signals to a remotely 
controllable device (See Fig. 1, items 1 1,30, in description see Col. 3, lines 25-48); at least on 
light detector that detects light from light source (See Fig. 1, item 3 1, in description see Col. 3, 
lines 32-35); a control unit that receives image data from at least one light detector (See Fig. 1 , 
item 30, in description see Col. 3, lines 32-45); wherein the control unit detects position of the 
hand-held device in at least two-dimensions from the image data from the at least one light 



Claim Rejections - 35 USC§103 
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detector and translates the position to control a feature on a display (See Fig. 1 , items 1 1 , 
30,31,37 in description see Col. 3, lines 46-54). 
Lin does not show "coded control signal". 

Lin teaches to remotely control a remotely controllable device (See Fig. 1, items 1 1,30, in 
description see Col. 3, Lines 46-51), using control module with processing section (See Fog. 1, 
items 33, 35, in description See 33-57). 

It would have been obvious to one of ordinary skill in the art at the time of invention to 
detect (decode) the position of the controlling spot using control module with processing section 
and application program coded by the application program in order to effect a mouse double 
click (See Col. 2, Lines 1-5). 

As to claim 2, Lin teaches at least one light detector is a digital camera (See Fig. 1 , item 
30, in description see Col. 3, lines 32-45). 

As to claim 3, Lin teaches digital camera captures a sequence of digital images that 
include the light emitted by the hand-held device transmitted to the control unit (See Fig. 1 , items 
30-31, 63a-63n, in description See Col. 4, Lines 17-33). 
(See Fig. 1, items 30-31, 63a-63n, in description See Col. 4, Lines 17-33). 

As to claim 4, Lin teaches the control unit comprises an image detection algorithm that 
detects the image of the light of the hand-held device in the sequence of images transmitted from 
the digital camera (See Fig. 1, items 16, 33,35, 63a-63n, in description See Col. 4, Lines 33-54). 

As to claim 5, Lin teaches the control unit maps a position of the detected hand-held 
device in the images to a display space for the display (See Fig. 1, items 13,16, 37, in description 
See Col. 6, Lines 6-20). 
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As to claim 6, Lin teaches the mapped position in the display space controls the 
movement of a feature in the display space (See Fig. 1, items 13,16, 37, in description See Col. 
6, Lines 21-45). 

As to claim 7, Lin teaches the feature in the display space is a cursor (See Col. 1, Lines 

27-46). 

As to claims 8-9, Lin teaches the captured images processed by the control unit for the 
purpose of teleconferencing (presentation), image transmission, and image recognition (See Col 

2, lines 30-34). 

3. Claim 23, is rejected under 35 U.S.C. 103(a) as being unpatentable over Rice et al. (US 
Patent 5,973,672). 

Rice at al. teaches a system comprising two or more movable hand-held devices, each 
hand-held device with at least one light source at least one of the two or more movable hand-held 
device being capable of sending control signals to a remotely controllable device (See Fig. 1 , 
items 15,25, in description See from Col. 1, Line 61 to Col. 2, Line 54), at least one light 
detector detecting light from the at least one light source of each of the two or more hand-held 
devices (See Fig. 1, item 18, in description See Col. 1, Line 61 to Col. 2, Line 26), a control unit 
that receives image data from the at least one light detector (See Fig. 1, items 19-23, in 
description See Col. 1 , Line 61 to Col. 2, Line 26), wherein the control unit detects the positions 
for each of the two or more movable hand-held devices in at least two dimensions from the 
image data from the at least one light detector and translates the positions for each of the two or 
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more movable hand-held devices to separately control two or more respective features on a 
display (See Fig. 1 5 items 19-23, in description See Col. 1, Line 61 to Col. 2, Line 26). 
Rice et al. does not show "coded control signal". 

Lin teaches to remotely control a remotely controllable device (See Fig. 1, items 21-23, in 
description see Col. 2, Lines 28-48), using computer and video generator device (See Fig. 1, 
items 21, 23, 13, in description See 29-33). 

It would have been obvious to one of ordinary skill in the art at the time of invention to 
detect (decode) the position of the controlling spot using control module with processing section 
and application program which was coded by the application program in order to provide a 
wireless multiple participant interactive interface system (See Col 1, Lines 27-28). 

4. Claim 10 rejected under 35 U.S. C. 103(a) as being unpatentable over Lin as 
aforementioned in claim 1 in view of Kim. et al. (US Patent No. 6,424,335 Bl). 

Lin does not show at least one light source is an LED. 

Kim et al. teaches LED as light source See Fig. 1, item 100, in description See Col. 8, 
Lines 44-58). It would have been obvious to one of ordinary skill in the art at the time of 
invention to use LED as light source as shown by Kim et al. in the Lin apparatus in order to 
achieve wireless input device which is energy efficient, consistent with operating the input 
device an extended distance from the computer (See Coll. 3, Line 66 to Col. 4, Line 2 in the Kim 
et al reference). 

5. Claims 1 1-16 rejected under 35 U.S.C 103(a) as being unpatentable over Lin as 
aforementioned in claim 1 in view of Fitts (US Patent No. 5,175,601). 
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As to claims 11-12, Lin does not show two digital cameras each capture a sequence of 
digital images that include the light emitted by the hand-held device, transmitted by each camera 
to the control unit. 

Fitts teaches two cameras with digitizers and processing of digitized images (See Fig. 1, 
items 2-3, 13,15, in description See Col. 7, Lines 45-68). It would have been obvious to one of 
ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in the Lin 
apparatus to allow two digital cameras each capture a sequence of digital images that include the 
light emitted by the hand-held device, transmitted by each camera to the control unit in order to 
permit on line interaction (See Coll. 6, Line 45-46 in the Fitts reference). 

As to claim 13, Lin teaches an image detection algorithm that detects the image of the 
light of the hand-held device in each sequence of images transmitted from digital camera (See 
Fig. 1, items 16, 33,35, 63a-63n, in description See Col. 4, Lines 33-54). 

Lin does not show two digital cameras. 

Fitts teaches two cameras with digitizers and processing of digitized images (See Fig. 1 , 
items 2-3, 13,15, in description See Col. 7, Lines 45-68). It would have been obvious to one of 
ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in the Lin 
apparatus to develop an image detection algorithm that detects the image of the light of the hand- 
held device in each sequence of images transmitted from two digital cameras in order to permit 
on line interaction (See Coll. 6, Line 45-46 in the Fitts reference). 

As to claim 14, Lin does not show the control unit with depth detection algorithm that 
uses the position of the light in the images received from each of the two cameras to determine a 
depth parameter from a change in a depth position of the hand-held device. 
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Fitts teaches two cameras with digitizers and processing of digitized images (See Fig. 1, 
items 2-3, 13,15, in description See Col. 7, Lines 45-68). It would have been obvious to one of 
ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in the Lin 
apparatus to develop depth detection algorithm that uses the position of the light in the images 
received from each of the two cameras to determine a depth parameter from a change in a depth 
position of the hand-held device cameras in order to permit on line interaction (See Coll. 6, Line 
45-46 in the Fitts reference). 

As to claims 15-16, Lin does not show the control unit maps a position of detected hand- 
held device in at least one of the images from one of the cameras and depth parameter to a 3D 
rendering in a display space and mapped position controls the movement of a feature in 3D 
rendering in the display space. 

Fitts teaches to use identifiable points on 3-D surface and measuring X-Y-Z 
coordinates of these points based on knowledge of how two cameras are referenced to each other 
(See Fig. 1, items 2-3, 12, in description See Col. 3, Lines 33-54). It would have been obvious to 
one of ordinary skill in the art at the time of invention to use two cameras as shown by Fitts in 
the Lin apparatus to map a position of detected hand-held device in at least one of the images 
from one of the cameras and depth parameter to a 3D rendering in a display space and mapped 
position controls the movement of a feature in 3D rendering in the display space in order to 
permit on line interaction (See Coll. 6, Line 45-46 in the Fitts reference). 

6. Claims 17-21 rejected under 35 U.S.C. 103(a) as being unpatentable over Lin as 
aforementioned in claim 1 in view of Arita et al. (US Patent No. 6,188,388 Bl). 
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As to claims 17-18, Lin does not show two light sources in one hand-held unit and the 
digital camera captures a sequence of digital images that includes the light from the two light 
sources of the hand-held, the sequence of images transmitted to the control unit. 

Arita et al. teaches two light sources in one hand-held unit (See Fig. 1,9-10, items Pb, 
Kh, Ki, in description See CoL12, Lines 1 1-25). It would have been obvious to one of ordinary 
skill in the art at the time of invention to use two light sources as shown by Arita et al. in the Lin 
apparatus to allow the digital camera captures a sequence of digital images that includes the light 
from the two light sources of the hand-held, the sequence of images transmitted to the control 
unit in order to improve precision (See Coll. 4, Line 5-8 in the Arita et al. reference). 

As to claim 19, Lin show the control unit has an image detection algorithm (in abstract 
Lin identifies gesture spatial pattern which obviously if not inherently includes detection 
algorithm) Lin does not show detecting the image of the two light sources in the sequence of 
"images transmitted from the digital camera. 

Arita et al. teaches two light sources in one hand-held unit (See Fig. 1,9-10, items Pb, 
Kh, Ki, in description See Col. 12, Lines 1 1-25). It would have been obvious to one of ordinary 
skill in the art at the time of invention to use two light sources as shown by Arita et al. in the Lin 
apparatus to allow an image detection algorithm that detects the image of the two light sources in 
the sequence of images transmitted from the digital camera in order to improve precision (See 
Coll. 4, Line 5-8 in the Arita et al. reference). 

As to claims 20-21, Lin does not show and detected angular aspect of the hand-held 
device from the images of the two light sources does not maps angular aspect to a display space. 
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Arita et al. teaches two light sources in one hand-held unit (See Fig. 1,9-10, items Pb, 
Kh, Ki, in description See Col. 12, Lines 1 1-25). It would have been obvious to one of ordinary 
skill in the art at the time of invention to use two light sources as shown by Arita et al. in the Lin 
apparatus to allow show and detected angular aspect of the hand-held device from the images of 
the two light sources does not maps angular aspect to a display space in order to improve 
precision (See Coll. 4, Line 5-8 in the Arita et al. reference). 

7. Claim 22 rejected under 35 U.S.C. 103(a) as being unpatentable over Lin as 
aforementioned in claim 1 in view of Fitts. 

Lin does not show light source emits visible light. 

Fitts teaches visible light as light source (See Fig. 1, item 8, in description See Col. 8, 
Lines 33-35). It would have been obvious to one of ordinary skill in the art at the time of 
invention to use visible light source as shown by Fitts in the Lin apparatus. 

8. Claims 24-26 rejected under 35 U.S.C. 103(a) as being unpatentable over Rice et al. as 
aforementioned in claim 23 in view Kim et al. 

Rice et al. does not show the at least one light source of the two or more hand-held 
devices each turn on and off at a flashing frequency and emit light at a flashing wavelength with 
different frequencies. 

Kim et al. teaches digital pulse format suitable for infrared transmission and detection as 
well known (see Fig. 2C, item 180, in description See Col. 8, Lines 44-58). It would have been 
obvious to one of ordinary skill in the art at the time of invention to use pulsing sources as shown 
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by Kim et al. in the Rice et al. apparatus at a flashing wavelength with different frequencies in 
order to allow input device is energy efficient (See Coll. 3, Line 66-67 in the Kim et al. 
reference). 

9. Claim 27 rejected under 35 U.S.C. 103(a) as being unpatentable over Rice et al. and Kim 
et al. as aforementioned in claim 26 in view of Fitts. 

Rice et al. and Kim et al. do not show light source emits visible light. 

Fitts teaches visible light as light source (See Fig. 1, item 8, in description See Col. 8, 
Lines 33-35). It would have been obvious to one of ordinary skill in the art at the time of 
invention to use visible light source as shown by Fitts in the Rice et al. and Kim et al. apparatus. 

Response to Amendment 

10. Applicant's arguments filed on 10-17-03 have been fully considered but they are not 
persuasive. 

On page 4, 2 nd paragraph, in relation to the independent claims 1 and 23, The Applicant 
stated that Lin and Rice references using "conventional" light pointers instead of commercially 
available hand-held device. However, these "conventional" light sources are satisfied all 
limitations of independent claims 1 and 23, including newly added: 'the movable hand-held 
device capable of sending coded control signals to a remotely controllable device' (See Abstract 
and Col. 3, Lines 52-54 in Lin reference and Col. 2, Lines 29-34 in Rice et al. reference). 

On page 5, third paragraph, Applicant stated that it would not be obvious to use a 
remote control (not in claims, in claims only light source is mentioned) as a pointing device on a 
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display. However, Rice et al. uses pointing device on a projection display (See Col. 2, Lines 29- 
34). In response to applicant's argument that there is no suggestion to combine the references, 
the examiner recognizes that obviousness can only be established by combining or modifying the 
teachings of the prior art to produce the claimed invention where there is some teaching, 
suggestion, or motivation to do so found either in the references themselves or in the knowledge 
generally available to one of ordinary skill in the art. See In re Fine, 837 F.2d 1071, 5 
USPQ2d 1596 (Fed. Cir. 1988) and In re Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 
1992). 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Leonid Shapiro whose telephone number is 703-305-5661. The 
examiner can normally be reached on 8 a.m. to 5 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bipin Shalwala can be reached on 703-305-4938. The fax phone number for the 
organization where this application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-4750. , 
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